Search AI Products and News

Recently, Professor Zhai Jidong's team from the Institute of High Performance Computing at Tsinghua University, in collaboration with Tsinghua-affiliated innovative enterprise, Qingcheng Extreme Intelligence, announced the open-sourcing of Chitu, a groundbreaking large model inference engine. This innovative technology marks another significant breakthrough for China in the AI field, particularly in inference engine development. A core highlight of the Chitu engine is its ability to natively run FP8 precision models on non-Nvidia Hopper architecture GPUs and various domestic chips.

In 2023, domestic large models have risen, facing challenges in computing power, characterized by 'external sanctions and internal development'. The ban has pushed domestic GPU chips into the spotlight, with Huawei Ascend and Cambricon becoming the focus. The computing power issue remains severe, and public cloud providers are addressing computing demands by 'centralizing computing power and substituting cloud for cards'. Data has become a key factor in the quality of large models, and high-quality language data may be exhausted, with a scarcity of Chinese datasets. In the future, companies may need to invest in finding quality data, with platforms like Zhihu and Douban potentially seizing development opportunities.